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(54) Electronic mail-capable communication terminal device and electronic mail communication 
method 



(57) A communication terminal device (F) which can 
send data by means of electronic mail or facsimile. The 
communication terminal device (F) first tries to send the 
data by electronic mail over a network. In the meantime, 
the electronic mail address and facsimile number corre- 
sponding to a recipient are both stored in a memory (7). 
When a predetermined response is not received from 
the network during a network connection operation, or 
"when there is mail returned in the sender's mailbox, the 
communication terminal device (F) dials the facsimile 
number of the recipient and transmits the mail image 
data via facsimile communication. ' ■ ■ 
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Description 

The present invention relates to an electronic mail- 
capable communication terminal device like a facsimile 
machine provided with the ability to access electronic 
mail. — 

In recent years, computer communication networks 
like the Internet, comprised of local computer communi- 
cation networks further networked over communica- 
tions lines and capable of transmitting electronic mail, 
have grown. Computer communication networks allow 
for easy error correction, and permit communication 
with computers not only domestically, but from over- 
seas, as well, at only the cost of communicating with a 
local provider (a service that provides connection to a 
computer network.) 

Conventional communication procedures and 
methods for Group 3 ("G3". International Telecommuni- 
cations Union (ITU)-T recommendation T.4) facsimile 
machines differ from that of computer communication 
networks, and therefore it is not possible to connect 
these machines directly to computer communication 
networks. However, by converting .into -electronic mail 
format the image data of a document to be" sent, facsim- 
ile machines can be enabled to transmit image data to 
these computer^communication networks. 

When a facsimile machine provided with electronic 
mail communication capabilities transmits electronic 
mail via the Internet, the facsimile machine dials the tel- 
ephone number of the Internet Service Provider ("ISP"),, 
logs-in by entering the user name and password of the 
registered user, and then sends electronic mail. The 
host computer of the provider locates and sends the 
mail to an optimal gateway on the Internet in order to 
transmit the mail to the mail address of the recipient. 
The electronic mail message is passed from gateway to 
gateway along the Internet, and finally to the server in 
which the recipient's mailbox is located. The mail is then 
stored in the mailbox at the recipient's electronic mail 
address. 

The recipient accesses the network, checks his or 
her mailbox, and if retrievable mail is found, downloads 
the mail from the mailbox. 

As described above, the mail sender must first 
access the network provider in order to send the mail. 
- However, during certain periods there may be heavy 
traffic on the ISP's phone lines, and this may prevent a 
user from being able to dial-in to its provider Further, if 
the user name or password input during log-in is incor- 
rect, the log-in will fail. Still further, if the recipient's mail 
box is overloaded, the mail box (mail server) may reject 
any new incoming messages. 

Further, when the sender .checks its mailbox and 
discovers the presence of mail that has been returned 
from the network because the recipient is unknown 
("returned mail"), the original document must be res- 
caned in order to be resent. The presence of the 
returned mail is known by finding the character code of 



995 A2 




the Subject field (whidi carries subject information of 
the mail such as title of the mail) in the data that follows 
the mail header and finding a particular code which 
specifies the sender itself in the character code. 

s It is an object of the present invention to provide an 

electronic mail-capable communication terminal device 
which reliably transmits electronic mail to a remote com- 
munication terminal device without delay To this end. 
the electronic mail-capable communication terminal 

10 device dials the facsimile number of the recipient's com- 
munication terminal device such that electronic mail 
data can be transmitted even at times when, for exam- 
ple, the sender is unable to connect to the provider, una- 
ble to log-in. unable to send mail even after logging-in, 

15 or during a certain time period when lines to the pro- 
vider can be expected to be busy 

It is another object of the present invention to pro- 
vide an electronic mail-capable communication terminal 
device which makes it unnecessary to rescan the origi- 

20 nal document when resending the mail. To this end. the 
electronic mail-capable communication terminal device 
stores the electronic mail message in its own image 
memory when it tries to send the mail over the network 
for the first time, or stores the mail message in its own 

25 mail box on the network by adding itself (the sender) as 
a recipient of the electronic mail. The mail message 
stored in the image memory or mailbox can be used 
when resending the. electronic mail. 

The electronic mail-capable communication termi- 

30 nal device of the present invention may be provided with 
a storage means for storing the electronic mail address 
and telephone number of a recipient, and a transmis- 
sion means for dialing the telephone number of the 
recipient and transmitting electronic mail data to the 

35 recipient when a predetermined response is not 
received during connection with the network. If, during a 
network connection operation the communication termi- 
nal device cannot connect to the provider over the tele- 
phone line or cannot log into the network, a 

40 predetermined response is not received from the net- 
work. Then, the communication terminal device dials a 
telephone number (facsimile number) of the destination 
and transmits the electronic mail as facsimile data. The 
facsimile number of the remote device is stored in the 

45 storage means beforehand in such a manner that the 
facsimile number is findable from the electronic mail 
address of the electronic mail recipient. Consequen- 
. tially even if electronic mail cannot be sent, the data can 
still be sent reliably via facsimile communication. 

50 The electronic mail-capable communication termi- 
nal device may further be provided with a second trans- 
mission means for transmitting the electronic mail data 
to the destination by dialing the telephone number (fac- 
simile number) of the recipient's device when mail can- 

55 not be transmitted over the network after connection 
with the network has been established. Mail reception 
may be refused by the provider (or server) on the recip- 
ient side after connection with the network has been 
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established. Then, the telephone number of the remote 
terminal device corresponding to the electronic nnail 
address of the destination stored in the storage means 
is dialed, and the electronic noail message is transmitted 
as facsimile data 

The electronic mail-capable communication termi- 
nal device may further be provided with a second stor- 
age means for storing a predetermined time period, and 
a third transmission means for transmitting the elec- 
tronic mail data by dialing the telephone number of the 
recipient when the current transmission time overlaps 
with the predetermined time period. A particular time 
period (for example, a time period when it can be 
assumed that the telephone lines of the provider will be 
busy) is stored. When electronic mail data is to be trans- 
mitted during this time period, the telephone number of 
the communication terminal device of the recipient cor- 
responding to the electronic mail address of the recipi- 
ent of the electronic mail message is dialed, and the 
data transmitted as facsimile data without being sent as 
electronic mail. Consequentially, even during time peri- 
ods when the phone lines to the provider are busy, data 
can be sent as facsimile data to a recipient without 
delay. 

According to a second aspect of the present inven- 
tion, the communication terminal device of the present 
invention provided with electronic mail and facsimile 
communication capabilities comprises a storage means 
for storing an electronic mail message which has been 
transmitted to a destination and information identifying 
such transmitted electronic mail, a detection means for 
detecting the presence of returned mail inside it's own 
mailbox, a comparing means for comparing the identify- 
ing information of the returned electronic mail with the 
identifying information stored by the storage means, 
and a transmission means-for resending to the destina- 
tion the electronic mail message from the storage 
means if the identifying information of the returned elec- 
tronic mail and the information stored by the storage 
means are the same. At least the subject information 
(e.g., title) of the mail is stored along with the message 
of the mail in the image memory when the mail is trans- 
mitted to the destination. When the presence of 
returned mail is detected in the mailbox, the subject 
information of the returned mail and the subject infor- 
mation stored in image memory are compared. If they 
are the same, the electronic mail message is resent 
from the image memory. Consequentially, the user does 
not have to rescan a document in order to resend the 
same mail 

The transmission means may resend the electronic 
mail stored from the memory via facsimile communica- 
tion. Consequentially, even if the electronic mail 
addressee is entered incorrectly and the electronic mail 
is undeliverable, the document to be sent can be reliably 
transmitted to the recipient by resending it via facsimile 
communication. 

The communication terminal device may further be 



provided with a means for additionally including the 
sender itself as a recipient of the electronic mail mes- 
sage being transmitted, and both the transmitted elec- 
tronic mail message and identifying information about 

5 this electronic mail message may be stored in the mail- 
box by specifying the sender as one of the recipients 
and transmitting a copy of the electronic mail message 
to the sender's mailbox. When electronic mail is trans- 
mitted, the sender itself is specified as one of the recip- 

70 tents of the electronic mail message by means of "c.c." 
for example. The transmitted message is also sent to 
the sender's mailbox, and can be saved in the mailbox 
as image data for resending or forwarding to another 
remote device. The memory of the communication ter- 

15 minal device is not used to store the mail and associ- 
ated information, but the mail box on the network is 
used. Consequentially the amount of memory taken up 
inside the sender's device can be reduced. 

20 F1G.1 is a block diagram of a first-embodi- 

ment of the present invention embod- 
Jed in a facsimile machine. 

FIGs.2 and 3 illustrate in combination a flow chart 
25 showing the operation of the facsimile 

machine shown in FiG.1 during elec- 
tronic mail transmission. 

FIG. 4 is a flow chart showing the operation of 

30 the facsimile machine shown in F1G.1 

during electronic mail reception. 

FIG. 5 is a flow chart showing the operation of 

a second embodiment of the present 
35 invention embodied in a facsimile 

machine during checking of a mailbox. 

FIG. 6 is a flow chart showing the operation of 

the facsimile machine of the second 
embodiment during electronic ' mail 
transmission with a copy of mail data 
being stored in an image memory. 

F1G.7 is a flow chart showing the operation of 

<5 the facsimile machine of the second 

embodiment using the electronic mail 
stored in the image memory by the pro- 
cedure of FIG. 6 during re-transmission 
or forwarding to another destination of 
50 electronic mail. 

FIG. 8 is a flow chart showing the operation of 

the communication terminal device of 
the second embodiment during trans- 
55 mission of electronic mail with a copy of 

the mail data being saved in the mail- 
box. 



3 



BNSDOCID: <EP 0887995A2> 




EPO 



FIG.9 is a flow chart showing the operation of 

the communication terminal of the sec- 
ond embodiment using the electronic 
mail stored in the mailbox by the proce- 
dure of FIG. 8 during re-transmission or 
forwarding of electronic mail. 

Referring to FIG. 1, illustrated is a block diagram 
showing the structure of a first embodiment of the elec- 
tronic mail-capable facsimile machine F according to 
the present invention. The facsimile machine F of this 
embodiment utilizes the Internet as a computer commu- 
nication network. 

CPU 1 controls not only the various hardware ele- 
ments of the facsimile machine F over buses, but also 
executes communication procedures of software stored 
in ROM 6 which includes encoding or decoding image 
data of an original document according to coding 
schemes such as MH, MR, MMR. etc.. converting the 
coded image data to and from TIFF format, converting 
to and from binary text format, editing the electronic 
mail, switching the modems, and controlling the 
RS232C line by using AT commands. 

At times when, for example, connection cannot be 
achieved with the provider over the phone line, log-in 
fails, mail reception is refused after logging in. electronic 
mail is to be transmitted during a particular time period 
(for example, when it can be assumed that lines to the 
provider will be busy), or when there is returned mail in 
the mailbox. CPU 1. as described in detail below, dials 
the facsimile number of the recipient, executes a soft- 
ware procedure to transmit the electronic mail image 
data as facsimile data, and executes a software proce- 
dure to print out notification that the recipient's facsimile 
number was dialed and that electronic mail image data 
was sent as facsimile image data. 

In image format conversion, when electronic mail 
image data is transmitted, the G3-formatted image data 
is converted into a TIFF (Tagged Image File Format) 
image data which can be used by common computers. 
When image data is received, the image is converted 
back from TIFF to G3 format. TIFF format has been 
made public by Adobe Systems, Inc.. and treatment of 
various classes of image data has been specified 
including not just binary black-and-white data, but also 
gray-scale and full-color. One of these classes, class F. 
defines the conversion of image data by MH. MR. MMR, 
etc., (i.e.. encoded G3-type image data). Consequen- 
tially, by appending Class F TIFF header information to 
the top of the G3 image data. TIFF conversion can be 
enabled. 

In binary text conversion, binary data is converted 
to text data when electronic mail image data is transmit- 
ted, and text data is converted to binary image data 
when electronic mail image data is received. Since 
some computers on the Internet cannot handle elec- 
tronic mail of binary image data, when binary TIFF 
image data is sent over the Internet, it must first be con- 
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verted to text data in order for it to be reliably received 
by the recipient. The text data format for i^e over the 
Internet has been specified as 7-bit code in RFC 
(Request For Comments) 822 published by the Internet 
5 Engineering Task Force (IETF). 

RFC 822 and 1341 discloses how to use MIME 
(Multipurpose Internet Mail Extensions) base 64 to con- 
vert between binary and text data. According to this 
method, each of 64 characters (capital letters, lower 
70 case letters, numbers, and and T) is assigned to 
one value of the 6-bit binary data set for executing the 
conversion to text data. 

In mail editing, when electronic mail image data is 
sent. CPU 1 appends electronic mail header information 
15 to the text-formatted TIFF image data enabling it to be 
sent as electronic mail. When electronic mail image 
data is received. CPU 1 removes the electronic mail 
header information from the electronic mail text format- 
ted data, and extracts the text data-converted TIFF 
20' image'data. Since certain information is included in'the 
header of Internet electronic mail for administrative pur- 
poses. CPU 1 appends "From: (the user's electronic 
mail address)," "To; , (the recipient's electronic mail 
address)," and "Subject: (the title or subject informa- 
25 tion)" to the top of the TIFF image data. 

The scanner 2 scans an image with an image scan- 
ner like a CCD and outputs binary black-and-white 
image data. The printer 3 is provided with an electro- 
photography type printer and outputs image data 
30 received from other G3 facsimile machines or received 
over the Internet. The display unit 4 is provided with an 
LCD device, and displays the operating status of the 
facsimile machine F and image data. 

The control panel 5 contains a number pad, speed- 
35 dial keys, one-touch dialing keys and various function 
keys required to operate the facsimile machine R Recip- 
ients' mail addresses and facsimile numbers are regis- 
terable in connection with the one-touch dial keys in the 
form of table created in the memory ROM 6 stores soft- 
40 ware required to operate the facsimile machine F RAM 
7 is comprised of SRAM, flash-memory or the like, and 
temporarily stores data generated during execution of 
the software. RAM 7 is provided with Table T1 contain- 
ing, for exannple, the facsimile numbers and electronic 
45 mail addresses of the recipients corresponding to the 
one-touch dial keys. RAM 7 also stores Table T2 con- 
taining the predetermined time periods (the time at 
which it can be expected that the phone lines to the pro- 
vider will be busy, for example), selection of transmis- 
50 sion mode according to the time of calling the provider 
(whether or not the facsimile machine F only sends data 
by means of facsimile transmission without sending the 
data by means of electronic mail if the time of calling the 
provider is in the predetermined time period), the 
55 number of times the facsimile machine F should try to 
redial the provider when it fails to connect, and the 
number of times the facsimile machine F should try to 
log in when it fails to long in after establishing the con- 
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nection with the provider. 

The image memory 8 is comprised of DRAM or the 
like, and stores image data. The modem 9 is a modem 
for normal facsimile communication of image data 
scanned in by the scanner 2. and is not provided with s 
data communication capabilities. The data modem 10 is 
a modem for communication of image data converted to 
electronic mail for transmission or reception via the 
Internet. The data modem 10 is connected to. for exam- 
. pie. an external telephone terminal provided in a chip io 
inside NCU 11 via a telephone cable, and also con- 
nected to the serial port of an l/F 12 which is used for 
connection of a personal conrputer via an RS232C line, 
NCU 1 1 opens and closes an analog telephone circuit. 
The clock circuit 1 3 determines the current time. is 

Next, the electronic mail transmission procedure of 
the facsimile machine F will be described based on the 
flow chart of FIGs. 2 and 3, 

A recipient is selected by pressing a one-touch dial 
key (Step S1). When the start key is pressed (Step S2). so 
CPU 1 references Table T2 in RAM 7 and determines if" 
the facsimile machine F has been set to an automatic 
faxyemail selection mode depending upon the time of 
data transmission (data is normally transmitted to a des- 
tination by means of electronic mail, but it is a peak time, 25 
data is transmitted by facsimile procedures (Step S3). If 
this automatic fax/email selection mode is OFF. the pro- 
gram proceeds to Step S5. 

If. however, the automatic selection mode is ON. 
then the CPU 1 checks the current time from the clock 30 
circuit 13. and determines whether the current time 
overlaps with the preprogrammed provider peak times 
stored in Table T2 of RAM 7 (Step S4). If the current 
time does not overlap with the programmed ISP peak 
time, then the program proceeds to Step 85 and dials 35 
the ISP. 

If, however, the current time overlaps with the pro- 
grammed ISP peak time, then CPU 1 references Table 
T1 in RAM 7 to determine whether or not the facsimile 
number of the recipient is stored along with the elec- 40 
tronic mail address corresponding to the one-touch dial 
key just pressed (Step Si 3). If the CPU 1 determines 
that no facsimile number is available, the program ends; 
but if a facsimile number is found, the mail image data is 
transmitted to the remote facsimile machine via a nor- 45 
mal facsimile transmission procedure (Step 814). 

If the facsimile machine F is not set to the automatic 
fax/email selection mode to avoid performing electronic 
mail delivery during ISP peak times (No at Step S3), or 
if the current transmission time does not overlap with so 
the programmed ISP peak time (No at Step S4), the 
provider is dialed (Step 85). and CPU 1 determines 
whether connection with the ISP has been successfully 
achieved by determining whether or not a particular 
response signal is received over the telephone line from 55 
the provider (Step 86). 

If the predetermined response signals are not 
received over the phone line from the provider and con- 



nection has failed, connection with the provider is reat- 
tempted by redialing the provider up to a specified 
number of times recorded in Table T2 stored in RAM 7 
(Steps 85-87). 

If the provider is repeatedly dialed the specified 
number of times but connection with the provider is still 
not achieved, the CPU 1 checks Table Tl in RAM 7 to 
determine whether or not a facsimile number is availa- 
ble for the electronic mail address corresponding to the 
one-touch dial key the user specified at Step 81 (Step 
813). If CPU 1 determines that no such facsimile 
nurnber is stored, th^e. program ends! but if a facsimile 
number is available, the CPU 1 sends the electronic 
mail image data to the remote facsimile machine by fac- 
simile communication by way of a normal facsimile com- 
munication procedure (Step 814).- * 

If connection with the provider is.achieved on the 
first attempt, or within the specified number of times of 
redialing, the login-script is executed (Step 58). Suc- 
cess of logging-in is determined depending upon 
whether or not the predetermined response signal is 
received from the ISP (Step 59). 

If the response signals are not received from the 
ISP and logging-in fails, the CPU 1 will reattemptto log- 
in up to the specified number of times listed in Table T2 
in the RAM 7 (Step 88 through Step SIO). 

If logging-in is not achieved in spite of reattempting 
the specified number of times, CPU 1 checks Table T2 
in RAM 7 to see whether or not a facsimile number is 
available for the electronic mail address corresponding 
to the one-touch dial key the user specified at Step 81 
(Step 813). If it is determined that no such facsimile 
number is stored, the program ends, but if a facsimile 
number is available, the electronic mail image data is 
sent to the remote facsimile machine via normal facsim- 
ile communication (Step S14). 

If log-in is successful on the first attempt, or within 
the specified number of attempts, the electronic mail 
data is transmitted over the phone line (Step 81 1). CPU 
1 then determined if electronic mail transmission has 
been completed or not by detecting if predetermined 
response signals are received from the mail server 
upon sending of the electronic mail data (Step 812). 

If the predetermined response signals are not 
received from the remote mail server and electronic 
mail uploading is thus not completed successfully, the 
CPU 1 checks Table Tl in RAM 7 to see whether or not 
a facsimile number has been stored along with the elec- 
tronic mail address in the one- touch dial key table (Step 
813). If it is determined that no such facsimile number is 
stored, the program ends, but if a facsimile number is 
available, the electronic mail data is sent to the remote 
facsimile machine via normal facsimile communication 
(Step 814). 

If the predetermined response signals are received 
from the remote mail server and mail uploading has 
been completed, then the program ends. 

Further. the printer 3 of the facsimile machine F 
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prints out notification to the effect that the electronic 
mall image data has been transmitted by facsimile 
transmission when this is the case. 

Next, the electronic mail reception procedure by the 
facsimile machine F of the present embodiment will be 
described with reference to the flow chart of FIG. 4. 

The facsimile machine F dials the provider (Step 
S21), and executes the log-in script (Step S22). When 
the facsimile machine F successfully logs in. it checks a 
mailbox (Step S23), and searches to determine if there 
are any messages to download (Step S24). 

If there is no mail to be downloaded the facsimile 
machine F performs a log-out script (Step S30) and the 
program ends. - -~ 

On the other hand, if there is mail to be down- 
loaded, the mail is retrieved (Step S25). The CPU 1 
then determines by means of checking the header infor- 
mation of the received message whether or not this mail 
Is a malt returned back without reaching the recipient's 
mail server (Step S26). 

If the received mail is not returned mail. CPU 1 
determines whether there is another message to be 
downloaded (Step S24). and continues executing Steps 
S24 through S29 until all the mail to be downloaded has. 
been retrieved. 

If the received mail is the returned mail. CPU 1 
checks Table T1 in RAM 7 to see whether or not a fac- 
simile number of the recipient is available together with 
the electronic mail address corresponding to the one- 
touch dial key pressed by a user (Step S27). If it is 
determined that no such facsimile number is stored, the 
program ends, but if a facsimile number is available, the 
electronic mail data is sent to the remote facsimile 
machine via normal facsimile communication (Step 
S28). 

Further, the facsimile machine F prints out notifica- 
tion from the printer 3 to the effect that the electronic 
mail image data has been transmitted by facsimile 
transmission. 

It should be noted that the checking of the mail box 
described above may be performed following the elec- 
tronic mail transmission (e.g., the step S23 may be exe- 
cuted following the step S12 of Frg.3). 

Further, electronic mail transmission between two 
facsimile machines has been described in the above 
embodiment of the present invention, but the present 
invention may also be applied to any communication 
terminal device provided with electronic mail communi- 
cation capability, like a personal conrtputer, for example. 

A second embodiment of the present invention is 
now described with reference to FlGs 5 through 9. 
Since the hardware configuration of this second embod- 
iment is the same as in the first, a description of this 
structure is herein omitted. 

First, tile mail box checking operation of the facsim- 
ile machine will be described based on the flow chart in 
FIG. 5- 

CPU 1 checks the mail box and determines 



whether or not there is returned mail (Step S31). It then 
determines whether or not the original document data 
which can be resent or forwarded has been saved in 
DRAM (image memory 8) at Step S32. If such data has 

5 been saved, CPU 1 extracts and stores the Subject 
(field) of the returned mail existing after the header of 
the returned mail in a predetermined region of RAM 7 
(Step S33), and compares this Subject with the Subject 
of the data saved in the DRAM (Step S34). 

10 If the subjects are the same (Step S35). CPU 1 then 
checks to see if the facsimile number of the recipient is 
stored along with the image data in the image memory 
8 (Step S36). If the facsimile number is not stored, the 
facsimile machine resends the image data to the desti- 

15 nation from the image memory 8 by electronic mail 
transmission (Step S37). 

On the other hand, if the facsimile number is stored 
in the image memory 8. the facsimile machine F now 
sends the image data from the image memory 8 to the 

20 recipient facsimile machine via facsimile transmission 
(Step S38). This is because there is a high probability 
that the reason the mail was returned was that the recip- 
ient's address is incorrect. 

If the image data is retransmitted in either Step S37 

25 or Step S38. the facsimile machine prints out or displays 
a message such as "Subject: XXX resenf (Step S39), 

If it is determined at Step S32 that there is no Image 
data for retransmission or forwarding saved in the 
DRAM or at Step S35 that there is no data having the 

30 same Subject stored in DRAM, then the facsimile 
machine downloads the returned mail and prints it out 
(Step S40), thereby informing the user of the presence 
of returned mail. The user then rescaps the undelivered 
original document, and resends it to the recipient via 

35 either electronic mail or facsimile transmission. 

When electronic mail retransmission or printing out 
is completed, the facsimile machine sends a command 
to the provider network to erase the returned message 
in the mail box (Step 841). 

40 Next, the operation of the facsimile machine when 
image data is stored in DRAM for retransmission or for- 
warding to another destination while the image data is 
being first transmitted to the destination by electronic 
mail and the operation of the facsimile machine when 

45 the data is actually resent or forwarded to another des- 
tination from DRAM will be described based on the flow 
charts in FlGs. 6 and 7. 

The user inputs a user number (Step 842), and 
selects a recipient by pressing a one-touch dial key or 

50 directly inputting the character code of a recipient 
address (Step S43). When the user presses a start key 
(Step S44). CPU 1 then determines whether or not the 
user's electronic mail address is added as a carbon 
copy (cc) recipient (Step S45). 

55 If the user is specified as the cc recipient, the fac- 
simile machine F requests the user to enter the charac- 
ters of the title of the original document (Step S46) and 
sends the image data to the designated recipient from 
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the image memory 8 except for the cc recipient (Step 
S47). In the meantime, the CPU 1 stores the image data 
for a predetermined time without erasing it from the 
image memory 8 after transmission (Step S48). 

On the other hand, if the user is not specified as a 5 
cc redpient at Step S45. the facsimile machine trans- 
mits the image data from the image memory 8 to all 
specified recipients via electronic mail transmission 
(Step S49). and erases the image data from the image 
memory 8 (Step S50). 

In this way the image data to be resent or fonwarded 
to additional recipients is saved in the image memory 8 
when the mail is first transmitted. When the mail is 
returned and retransmission is required. or the same 
message is to be fonwarded to additional recipients, the 75 
user switches the facsimile machine F to an electronic 
mail transmission mode from a stand-by mode (Step 
S51). 

When the user code is entered (Step S52). the CPU 
.1 determines whether or not an original document has 20 
been placed in a document hopper (not shown) (Step 

553) . If a document has not been placed in the hopper, 
the facsimile machine F displays a list of the subject 
information of the documents (e.g., titles of the docu- 
ments or image data, or addresses of the recipients) 25 
saved in the image memory 8 on the LCD of the display 
unit 4. By selecting one of numbers appended to the 
subject information in the displayed list, the user can 
specify a mail message to be resent or forwarded (Step 

554) . Since there is a high probability that the cause of 30 
the mail being returned is a mistaken address, the mail 
address is manually input b7 tRe user (Step S55jr When 
the user presses the Start key, the facsimile machine F 
begins the mail transmission process (Step S56). 

On the other hand if a document has been placed 35 
on the hopper at Step S53, the program moves to Step 
S55 to perform a normal transmission procedure. The 
user specifies the recipient either by pressing a one- 
touch dial key or inputting the character string of the 
recipient's address directly (Step S55). When the user 40 
presses the start key, the facsimile machine begins the 
electronic mail transmission process (Step S56). 

Next, the mail transmission process when the elec- 
tronic mail image data to be resent or forwarded is 
stored in a mailbox of the network, and the mail retrans- <5 
mission/forwarding process when the mail data is sent 
from the network mailbox will be described based on the 
flow charts in FIGs. 8 and 9. 

The user enters their user number (Step S61), and 
then specifies a recipient by either pressing a one-touch sc 
dial key or manually entering the character string of the 
recipient address (Step S62). When the user hits the 
start key, the CPU 1 determines whether or not the 
user's mail address is added as a carbon copy (cc) 
recipient (Step S63). si 

If the user is specrf ied as a cc recipient, the facsim- 
ile machine F. prompts the user to enter the character 
string of the subject irtformation of the original docu- 



ment to be sent such as title of the document (Step 
S64). and stores the subject data in RAM 7 (Step S65). 
Next, the facsimile machine F transmits the image data 
from the image memory 8 to all addressees by elec- 
tronic mail (Step S66), and CPU 1 erases the image 
data from the image memory 8. 

If the user is not specified as a cc recipient at Step 
S63, then the facsimile machine immediately transmits 
the image data from the image memory 8 to all specified 
recipients (Step S66). and CPU 1 erases the image 
data from the image memory 8. 

In this way the facsimile machine can save image 
data which can later be resent or fonwarded in the net- 
work mailbox by specifying the user itself as one of the 
cc recipients of the message being sent when electronic 
mail image data is first transmitted. When the mail is 
returned and should be resent or the same mail mes- 
sage is to be fonwarded to additional recipients, the user 
switches the facsimile machine F to the electronic mail 
communication mode from the stand-by mode -(Step 
S71), and enters a user number (Step S72). 

The CPU 1 then determines whether or not a docu- 
ment has been placed in the hopper (Step S73). If a 
document has not been placed in the hopper, the fac- 
simile machine F displays a list of subject information of 
the documents saved in RAM 7 on the LCD of the dis- 
play unit 4. By specifying one of numbers assigned to 
the subject information displayed, the user can select a 
message to be resent or fonwarded to other remote 
devices (Step S74). Since there is a high probability that 
the cause of the mail being returned is a mistaken 
address, the electronic mail address of the concerned 
. message is manually input by the user (Step S75). 

When the user presses the Start key (Step S76), 
the CPU 1 searches the mail box on the network for an 
electronic mail message with the same subject line as 
that selected by the user at Step S74 (Step S77). 

The facsimile machine checks the mailbox to see if 
there are any pages missing from the mail or if any of 
the messages were not delivered (Step S78). If there 
are no missing pages and there are no undelivered 
messages, then the facsimile machine downloads the 
electronic mail (Step S29), and transmits it to the recip- 
ient specified at Step S75. 

On the other hand, if there are missing pages or 
undelivered mail at Step S78. the facsimile machine dis- 
plays or outputs an error message (Step S80). 

Further, if it is determined at Step S73 that a docu- 
ment has been placed in the hopper, this indicates a 
t normal transmission operation. Therefore, as the recip- 
ient is specified either by the one-touch key or by man- 
ually input (Step S82) and the start key is pressed (Step 
S83). the facsimile machine F begins the mail transmis- 
sion (Step S81). 
) The above described embodiment has been 
described as transmission between two facsimile 
machines, but the present invention also may be used in 
any electronic mail-communication capable communi- 



7 



BNS0OCID:<EP 0887995A2> 



13 



EP 0 887 995 A2 



14 



cation terminal device, such as a personal computer. 
Claims 

1 , A communication terminal device (F) provided with 5 
electronic mail communication capability including 
electronic mail means (1) for transmitting electronic 6. 
mail to a recipient over a network, characterized in 

that the communication terminal device (F) further 
includes: w 

first storage means (7) for storing a facsimile 
number of a recipient corresponding to an elec- 
tronic mail address of an electronic mail recipi- 
ent; and 15 
first transmission means (1) for transmitting 7. 
electronic mail data to a recipient in the form of 
facsimile data by dialing the recipient's facsim- 
ile number when a predetermined response is 
not received during a network connection oper- 20 
ation or when connection to the network fails. 

2. The communication terminal device (F) of claim 1 , 
characterized in that the communication terminal 
device further includes: 25 , 



second storage means (7) for storing a prede- 
termined time period; and 
second transmission means (1 ) for transmitting 
the electronic mail data to a recipient in the 
form of facsimile data by dialing the recipient's 
facsimile number when an electronic mail 
transmission time falls within the predeter- 
mined time period. 



30 



35 8. 



The communication terminal device (F) of claim 2. 
characterized in that the second transmission 
means transmitting the electronic mail data to a 
recipient in the form of electronic mail when an 
electronic malt transmission time does not fall 
within the predetermined time period. 

The communication terminal device (F) of claim 1 . 2 
or 3, characterized in that the communication termi- 
nal device (F) further includes third transmission 
means (1) for transmitting the electronic mail data 
to a recipient in the form of facsimile data by dialing 
the recipient's facsimile number when electronic 
mail cannot be transmitted after connecting to a 
network. 

The communication terminal device (F) of claim 4. 
characterized in that the communication terminal 
device further includes: 

third storage means (7) for storing a predeter- 
mined time period; and 

fourth transmission means (1) for transmitting 



50 
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the electronic mail data to a recipient in the 
form of facsimile data by dialing the recipient's 
facsimile number when the electronic mail 
transmission time falls within the predeter- 
mined time period. 

The communication terminal device (F) of any one 
of foregoing claims, characterized in that the com- 
munication termrnal device further includes fifth 
transmission means (1) for transmitting the elec- 
tronic mail data to a recipient in the form of facsimile 
data by dialing the facsimile number of the recipient 
when log-in fails after attempting to execute a log-in 
script a predetermined number of times. 

A method of selectively transmitting data to a recip- 
ient in the form of electronic mail over a network or 
in the form of facsimile data over a telephone line, 
comprising the steps of: 

A) connecting to the network; 

B) transmitting the electronic mail to the net- 
work if the step A) is succeeded; 

C) finding a facsimile number of a recipient 
based on an mail address of the electronic mail 
transmitted by the step B) when a predeter- 
mined response is not received from the net- 
work or the recipient during or after the step B). 
or when the step A) fails; 

D) dialing the facsimile number of the recipient; 
and 

E) transmitting the data in the form of facsimile 
data to the recipient. 

The method of claim 7, characterized in that the 
method further includes the step F) of storing an 
electronic mail address of a recipient in connection 
with a facsimile number of the recipient before the 
stepC). 

The method- of claim 7 or 8. characterized in that 
-the method further includes the steps of: 

G) determining whether a current time is in a 
predetermined time period before the step A); 

H) finding a facsimile nunrber of a recipient if 
the current time is in a predetermined period 
before the step A); and 

I) skipping the steps A) to C) if the current time 
is in a predetermined period and performing 
the steps D) and E). 

A communication terminal device (F) provided with 
electronic mail communication capability and fac- 
simile communication capability including first 
transmission means (1) for transmitting electronic 
mail to a recipient over a network, characterized in 
that the communication terminal device (F) further 
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includes: 

storage means (1. 8) for copying and storing 
the electronic mail transmitted to a recipient in 
a predetermined area; detection means (1) for 
detecting presence of returned mail in a mail- 
box: 

comparison means (1) for comparing the 
returned mail with the electronic mail stored in 
the predetermined area of the storage means; 
and 

second transmission means (1) for retransmit- 
ting the electronic mail from the predetermined 
area of the storage means when the compari- 
son means determines that the two mails are 
the same. 

11 . The communication terminal device (F) of claim 10, 
characterized in that the communication terminal 
device further includes means (1) for including the 
communication terminal device (F) itself as a recip- 
ient of the electronic mail message being transmit- 
ted, and wherein the predetermined area of the 
storage means is its own mailbox on the network. 

12. The communicatipn terminal device (F) of claim 10 
or 1 1 . characterized in that the second transmission 
means includes means for retransmits the elec* 
tronic mail by facsimile communication. 

13. The communication terminal device (F) of claim 12, 
characterized in that the communication terminal 
device further includes means (1) for including the 
communication terminal device (F) itself as a recip- 

, . ient of the electronic mail message being transmit- 
ted, and wherein the predetermined area of the 
storage means is its own mailbox on the network. 

14. The communication terminal device (F) of claim 10. 
11, 12 or 13, characterized in that the predeter- 
mined area is an memory (8) associated with the 
communication terminal device (F). 

15. The communication terminal device (F) of any one 
of claims 1 0 to 1 4, characterized in that the compar- 
ison means compares particular information 
included in the returned mail with particular infor- 
mation included in the electronic mail stored in the 
predetermined area of the storage means. 

1 6. A method for electronic mail transmission and fac- 
simile communication comprising the steps of: 

A) transmitting electronic mail to a recipient: 

B) copying and storing the electronic mail in a 
predetermined area; 

C) detecting presence of returned mail in a 
mailbox; 



D) comparing the returned mail with the elec- 
tronic mail stored in the predetermined area; 
and 

E) resending the electronic mail to the recipient 
5 from the predetermined area in the form of 

electronic mail or facsimile data when. the step 
D) determines that the two mails are the same. 

17. The method of claim 16. characterized in that the 
JO step B) includes including the communication ter- 
minal device (F) itself as a recipient of the electronic 
mail message being transmitted, and the predeter- 
mined .area is its own mailbox on the network. 

IS 18. The method of claim 16 or 17, characterized in that 
the predetermined area is an memory associated 
with the communication terminal device (F). 

19. The method of claim 16, 17 or 18. characterized in 
20 that the step D) compares particular information 
included in the returned mail with particular infor- 
mation included in the electronic mail stored in the 
predetermined area. 

25 
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